WavNet — Visual saliency detection using Discrete Wavelet Convolutional Neural Network

In the recent advancements in image and video analysis, the detection of salient regions in the image becomes the initial step. This plays a crucial role in deciding the performance of such algorithms. In this work, a Multi-Resolution Feature Extraction (MRFE) technique that makes use of Discrete Wavelet Convolutional Neural Network (DWCNN) for generating features is employed. An Enhanced Feature Extraction (EFE) module extracts additional features from the high level features of the DWCNN, which are used to frame both channel as well as spatial attention models for yielding contextual attention maps. A new hybrid loss function is also proposed, which is a combination of Balanced Cross Entropy (BCE) loss and Edge based Structural Similarity (ESSIM) loss that effectively identifies and segments the salient regions with clear boundaries. The method is tested exhaustively with five different benchmark datasets and is proved superior to the existing state-of-the-art methods with a minimum Mean Absolute error (MAE) of 0.03 and F-measure of 0.956.     

A comprehensive survey on computer vision based concepts,methodologies, analysis and applications for automatic gun/knife detection

The ability to detect gun and gun held in hand or other body parts is a typical human skill. The same problem presents an imperative task for computer vision system. Automatic observer independent detection of hand held gun or gun held in the other body part, whether it is visible or concealed, provides enhance security in vulnerable places and initiates appropriate action there. Compare to the automatic object detection systems, automatic detection of gun has very few successful attempts. In the present scope of this paper, we present an extensive survey on automatic detection of gun and define a taxonomy for this particular detection system. We also describe the inherent difficulties related with this problem. In this survey of published papers, we examine different approaches used in state-of-the-art attempts and compare performances of these approaches. Finally, this paper concludes pointing to the possible research gaps in related fields.     

Past is important: Improved image captioning by looking back in time

A major development in the area of image captioning consists of trying to incorporate visual attention in the design of language generative model. However, most previous studies only emphasize its role in enhancing visual composition at the current moment, while neglect its role in global sequence reasoning. This problem appears not only in captioning model, but also in reinforcement learning structure. To tackle this issue, we first propose a Visual Reserved model that enables previous visual context to be considered for the current sequence reasoning. Next, a Attentional-Fluctuation Supervised model is also proposed in reinforcement learning structure. Compared against the traditional strategies that only take non-differentiable Natural Language Processing (NLP) metrics as the incentive standard, the proposed model regards the fluctuation of previous attention matrix as an important indicator to judge the convergence of the captioning model. The proposed methods have been tested on MS-COCO captioning dataset and achieve competitive results evaluated by the evaluation server of MS COCO captioning challenge.     

Visually deficient working conditions and reduced work performance in office workers: Is it mediated by visual discomfort?

IntroductionThe main purpose of this cross-sectional study was to investigate whether visual discomfort acts as a mediating factor between perceived visual ergonomic working conditions and self-rated visual performance among office workers who carry out administrative tasks and computer-based work at the Swedish Tax Agency.MethodsA questionnaire was sent to 94 office workers addressing: 1) perceived visual quality of the visual display units; 2) prevalence of eye symptoms; and 3) self-rated visual performance. Eighty-six persons (54 women (63%), 31 men (36%), and 1 of unspecified sex) answered the questionnaire. Multiple regression analysis investigated the association between visual ergonomic working conditions and visual performance, both with and without visual discomfort as a mediator.ResultsThe group mean of the Indexed survey questions indicated a reasonably good quality of visual ergonomic working conditions, a relative absence of eye symptoms, and acceptable self-rated visual performance. Results from multiple regression analysis showed a significant association between perceived visual ergonomic working conditions and self-rated visual performance (r² = 0.30, β = 0.327, p < 0.01). When visual discomfort was used as a mediator, the association between perceived visual ergonomic working conditions and self-rated visual performance remained the same (r² = 0.32, β = 0.315, p < 0.01).DiscussionIt was remarkable to discover that self-rated visual performance was independent of visual discomfort. Possible explanations include exposure factors not included in the current study, such as dry air and sensory irritation in the eyes, psychosocial stress, time spent performing near work activities, or time exposed to visually deficient working conditions.Relevance to industryThe strong connection between satisfaction with visual ergonomic working conditions and productivity in this study has implications for workplace profitability and staff satisfaction. If productivity is enhanced by better visual ergonomic working conditions, then managers of workplaces may be able to improve work outcomes by optimizing the physical work environment.     

CV3: Visual Exploration,Assessment, and Comparison of CVs

The Curriculum Vitae (CV, also referred to as “résumé”) is an established representation of a person's academic and professional history. A typical CV is comprised of multiple sections associated with spatio‐temporal, nominal, hierarchical, and ordinal data. The main task of a recruiter is, given a job application with specific requirements, to compare and assess CVs in order to build a short list of promising candidates to interview. Commonly, this is done by viewing CVs in a side‐by‐side fashion. This becomes challenging when comparing more than two CVs, because the reader is required to switch attention between them. Furthermore, there is no guarantee that the CVs are structured similarly, thus making the overview cluttered and significantly slowing down the comparison process. In order to address these challenges, in this paper we propose “CV3”, an interactive exploration environment offering users a new way to explore, assess, and compare multiple CVs, to suggest suitable candidates for specific job requirements. We validate our system by means of domain expert feedback whose results highlight both the efficacy of our approach and its limitations. We learned that CV3 eases the overall burden of recruiters thereby assisting them in the selection process.     

Eye movements and visual discomfort when viewing stereoscopic 3D content

The visual brain fuses the left and right images projected onto the two eyes from a stereoscopic 3D (S3D) display, perceives parallax, and rebuilds a sense of depth. In this process, the eyes adjust vergence and accommodation to adapt to the depths and parallax of the points they gazed at. Conflicts between accommodation and vergence when viewing S3D content potentially lead to visual discomfort. A variety of approaches have been taken towards understanding the perceptual bases of discomfort felt when viewing S3D, including extreme disparities or disparity gradients, negative disparities, dichoptic presentations, and so on. However less effort has been applied towards understanding the role of eye movements as they relate to visual discomfort when viewing S3D. To study eye movements in the context of S3D viewing discomfort, a Shifted-S3D-Image-Database (SSID) is constructed using 11 original nature scene S3D images and their 6 shifted versions. We conducted eye-tracking experiments on humans viewing S3D images in SSID while simultaneously collecting their judgments of experienced visual discomfort. From the collected eye-tracking data, regions of interest (ROIs) were extracted by kernel density estimation using the fixation data, and an empirical formula fitted between the disparities of salient objects marked by the ROIs and the mean opinion scores (MOS). Finally, eye-tracking data was used to analyze the eye movement characteristics related to S3D image quality. Fifteen eye movement features were extracted, and a visual discomfort predication model learned using a support vector regressor (SVR). By analyzing the correlations between features and MOS, we conclude that angular disparity features have a strong correlation with human judgments of discomfort.     

Affine hull based target representation for visual tracking

Handling appearance variations is a challenging issue in visual tracking. Existing appearance models are usually built upon a linear combination of templates. With such kind of representation, accurate visual tracking is not desirable when heavy appearance variations are in presence. Under the framework of particle filtering, we propose a novel target representation for tracking. Namely, the target candidates are represented by affine combinations of a template set, which leads to better capability in describing unseen target appearances. Additionally, in order to adapt this representation to dynamic contexts across a video sequence, a novel template update scheme is presented. Different from conventional approaches, the scheme considers both the importance of one template to a target candidate in the current frame and the recentness of the template that is kept in the template set. Comprehensive experiments show that the proposed algorithm achieves superior performances in comparison with state-of-the-art works.     

What determines the take-over time? An integrated model approach of driver take-over after automated driving

In recent years the automation level of driver assistance systems has increased continuously. One of the major challenges for highly automated driving is to ensure a safe driver take-over of the vehicle guidance. This must be ensured especially when the driver is engaged in non-driving related secondary tasks. For this purpose it is essential to find indicators of the driver’s readiness to take over and to gain more knowledge about the take-over process in general.     

The visual impact of augmented reality during an assembly task

Many studies have shown the benefits of augmented reality (AR) to improve manufacturing and control processes in industry. However, the presentation of AR content through optical see-through head-mounted displays may induce unnatural viewing conditions, which consequences on the user’s visual system have not been investigated yet. This study aimed at assessing whether using AR instructions to guide a manual task, i.e., conditions where the user is forced to repeatedly look at and accommodate in different planes to extract information from both real and virtual environments, could potentially impact the visual system of operators. A before/after design study was carried out, asking 26 participants to perform Lego assemblies for 30 min with either paper or AR instructions. The effects of using AR compared to paper instructions were evaluated both on binocular vision, with classical optometric measurements, and on visual fatigue, with the Virtual Reality Symptoms Questionnaire. No clinically significant differences in optometric measurements (far/near visual acuity, stereoacuity, phoria, convergence, fusional amplitude, accommodation amplitude, accommodative convergence) have been found between AR and paper instructions, and only negligible fatigue symptoms have been seen specifically for AR. Results from both objective and subjective measurements suggest that there is no impact of AR on the oculomotor system and that, in this specific case of use, AR can be safely used for production operators.     

A comparison of visual ability and its importance awareness between novice and experienced drivers

The visual ability factors of peripheral perception, visual reaction and visual pursuit ability are important for safe driving. Thus, this study explored the influence of driving experience on these visual ability factors. Sixty-five drivers, including novice and experienced drivers, participated in this study. The visual ability levels of the three factors were measured by the Vienna Test System. In addition, driver's awareness of the three factors' importance for safe driving was measured by questionnaire items. Results showed that out of the three factors, drivers' peripheral perception ability was correlated significantly with their driving experience. Experienced drivers had higher peripheral perception ability than that of novice drivers. In addition, compared with novice drivers, experienced drivers believed that peripheral perception was more important whereas visual reaction was less important. It is suggested that higher attention should be paid to peripheral perception in driving training and novice drivers should increase their importance awareness for this factor.